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Summary _ _ REL 2010-No. 096 

What English language arts, math, 
and science instructional materials 
have districts in the Mid-Atlantic 
Region states adopted? 



This report describes results of an on- 
going project to generate and share 
information on core texts, supplemental 
materials, and benchmark assessments 
adopted by districts in the Mid-Atlantic 
Region states for language arts, math, 
and science courses in specific elemen- 
tary, middle, and high school grade 
levels. The results, described in the text, 
are also available in an online, searchable 
database. 

Despite increasing accountability require- 
ments and a national call for transparency in 
public policy, Mid-Atlantic Region state educa- 
tion agencies indicate that they have little in- 
formation about what instructional materials 
districts adopt. This report describes first-year 
results of an ongoing project to generate and 
share information on core texts, supplemental 
materials, and benchmark assessments ad- 
opted by districts in the Mid-Atlantic Region 
states for specific elementary, middle, and high 
school grade levels in English language arts, 
math, and science. The report also describes 
the organization of the results in an online, 
searchable database (http://www.relmid- 
atlantic.org/ci). Potential users of the database 
include state and local policymakers, practitio- 
ners, parents, voters, and researchers. 



Two research questions drive this ongoing 
project: 

• What instructional materials (core texts, 
supplemental materials, and benchmark 
assessments) have districts adopted in 
nine grade and content areas in English 
language arts, math, and science — and 
when? 

• To what extent have districts adopted ma- 
terials that the What Works Clearinghouse 
has found to have positive effects? 

From March 2009 to September 2009, at least 
some data were collected from 997 (90 percent) 
of the 1,113 eligible school districts in Dela- 
ware, the District of Columbia, Maryland, New 
Jersey, and Pennsylvania. Item response rates 
were much lower, however. For example, for 
algebra 1, only 53 percent of eligible districts 
provided a core text title, 13 percent a bench- 
mark assessment title, and 7 percent a supple- 
mental materials title. This report provides 
descriptive information about core texts and 
recommends refinements to the data collection 
approach for year 2 of the study. Because of the 
low item response rates, the report does not 
include data on supplemental materials and 
benchmark assessments. 
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Several findings emerge from analysis of the 
database. (Regional findings are dominated 
by results for New Jersey and Pennsylvania, 
which together contain 96% of responding 
districts.) 

• Few districts reported having adopted 
district-developed core text materials (0-2 
percent in each grade and content area) 
or no core text materials (0-3 percent). 
More districts (1-14 percent in each grade 
and content area) reported having ad- 
opted more than one core text, which may 
include commercially or locally developed 
materials; the practice is most common 
in English language arts (5-14 percent), 
less common in science (2-7 percent), 
and least common in mathematics (1-2 
percent). 

• Depending on the grade and content 
area, 34-64 percent of reporting districts 
provided both the title and publisher of a 
single commercially developed core text. 

In grade 1 reading, for example, 49 percent 
of reporting districts provided both the 
title and publisher of a core text, for a total 
of 60 unique combinations. 

• Districts were most likely to report both 
the title and publisher of a core text in 
grade 4 math (64 percent) and algebra 1 
(55 percent). They were least likely to re- 
port them in grade 8 English language arts 
(34 percent) and earth science (41 percent). 

• As of March 1, 2010, the What Works 
Clearinghouse (WWC) had issued re- 
ports on studies of 15 of the instruc- 
tional materials identified by districts in 
Mid-Atlantic Region states that had met 



WWC evidence standards with or without 
reservations. In 10 of these reports, the 
curricula were shown to have positive ef- 
fects or potentially positive effects. At the 
time of this study, 256 responding districts 
(26 percent) had adopted one or more 
components (a core text, a workbook, a 
journal, online exercises, or a reference 
book) of at least one of these materials, 
and 17 districts (2 percent) had adopted 
some component of two of them. Everyday 
Mathematics, published by McGraw Hill, 
was the only one of these materials to be 
widely adopted, with 235 districts (24 
percent of those reporting) adopting some 
edition of the core text or some supple- 
mental material or benchmark assessment 
associated with the curriculum. 

The experience gained during year 1 of the 
project informed recommendations for the 
operating plan for year 2: 

• Address two research questions in the 
original project plan that were not ad- 
dressed in year 1 related to analyses of 
adoption processes and amounts of profes- 
sional development. 

• Boost response rates and accuracy by 
giving districts lists of commonly adopted 
materials for each grade and content area 
and asking them to check the items they 
have adopted, fill in complete data if they 
have adopted materials that are not listed, 
or check options indicating that they have 
adopted no materials or do not offer the 
grade and content area. 

• Revise and expand the coding guide to 
make it more consistent, to further specify 
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types of materials adopted, and to include 
coding of multiple materials. 

• Develop a database capability to enable 
users to export data for their own use. 

The project responds to requests from state 
education agencies in the Mid-Atlantic Region 
that wanted to know what instructional materi- 
als and assessments districts had adopted and 
when, what criteria they had used in selecting 



the materials and assessments, and what 
professional development they had provided 
in association with adoptions. The requesting 
agencies want to assist districts in meeting 
requirements under the No Child Left Behind 
Act of 2001 but do not have access to compre- 
hensive or continuing information about core 
and supplemental materials adopted by the 
school districts for which they are responsible. 

December 2010 
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This report describes 
results of an 
ongoing project to 
generate and share 
information on core 
texts, supplemental 
materials, and 
benchmark 
assessments 
adopted by districts 
in the Mid-Atlantic 
Region states for 
English language 
arts, math, and 
science courses in 
specific elementary, 
middle, and high 
school grade 
levels. The results, 
described in the text, 
are also available 
in an online, 
searchable database. 



WHY THIS STUDY? 

In 20 states, local education agencies are required 
to use instructional materials selected by state 
education agencies or materials from an approved 
state list; in the remaining states, local education 
agencies select their own instructional materi- 
als (Zinth 2005). Research concentrates on how 
materials are selected (for example, Dixon 1994; 
Stein et al. 2001), the merits of statewide and local 
adoption (as in Finn and Ravitch 2004), and the 
effectiveness of the material (as in What Works 
Clearinghouse 2009b). Hie only studies of what 
instructional materials are adopted appear to be 
those relating to state adoption (as in Finn and 
Ravitch 2004). 

Under the No Child Left Behind (NCLB) Act of 
2001, districts and state agencies are increasingly 
seeing curriculum adoption as critical for schools 
or districts labeled in need of improvement 
because of lagging student subgroup achievement 
(Goertz 2005). High quality instructional materi- 
als are less likely to be adopted when staff are not 
trained in evaluation processes, are not familiar 
with the relevant research, lack sufficient time to 
conduct an evaluation, or rely on insufficiently rig- 
orous, publisher-supplied data and research (Stein 
et al. 2001) and anecdotal information. 

The NCLB Act requires states to align assess- 
ments with standards in English language arts, 
math, and science and to assist school districts in 
aligning curricula, pedagogy, and assessments to 
strengthen student outcomes and close achieve- 
ment gaps. The International Benchmarking Advi- 
sory Group, composed of governors, state commis- 
sioners of education, business leaders, researchers, 
former federal officials, and state and local 
officials, produced a research-based report that of- 
fers states a roadmap for benchmarking their K-12 
education systems against those of top-performing 
countries (National Governors Association, Coun- 
cil of Chief State School Officers, and Achieve, Inc. 
2008). The advisory group urged state leaders to 
upgrade state standards by adopting a common 
core of internationally benchmarked standards in 
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WHAT LANGUAGE ARTS, MATH, AND SCIENCE INSTRUCTIONAL MATERIALS HAVE DISTRICTS ADOPTED? 



Despite evidence that 
some instructional 
materials have positive 
effects, there has been 
no documentation of the 
extent to which districts 
are using such materials 



language arts and math for grades 
K-12 to ensure that students are 
equipped with the knowledge and 
skills necessary to be globally 
competitive. It also recommended 
leveraging states’ collective influ- 
ence to align textbooks, digital 
media, curricula, and assessments 
to internationally benchmarked 
standards and to draw on lessons from high-per- 
forming countries and states. The National Gov- 
ernors Association and the Council of Chief State 
School Officers have also taken the lead in the 
Common Core State Standards Initiative, designed 
to develop college- and career-ready standards 
benchmarked to those of top-performing coun- 
tries (www.corestandards.org). 



The goal of raising expectations for what students 
should know and be able to do academically makes 
it increasingly important to identify which instruc- 
tional materials are effective at improving student 
achievement. Despite evidence that some instruc- 
tional materials have more positive effects than 
do others, there has been no documentation of the 
extent to which districts are using such materials. 



The absence of systematic, current data about 
what instructional materials districts are adopting 
makes it difficult for state agencies and research 
organizations to understand and evaluate choices, 
problems, and trends related to district alignment 
of standards, curricula, and assessments. 1 



This project responds to requests from state edu- 
cation agencies in the Mid-Atlantic Region that 
wanted to know what instructional materials and 
assessments districts had adopted and when, what 
criteria they had used in selecting the materials 
and assessments, and what related professional 
development they had provided. 2 The Mid-Atlantic 
Region consists of Delaware, the District of Co- 
lumbia, Maryland, New Jersey, and Pennsylvania. 
The requests came from Delaware, New Jersey, 
and Pennsylvania. The requesting state education 
agencies want to assist districts in meeting NCLB 
requirements (No Child Left Behind 2001) but do 



not have access to comprehensive or continuing 
information about core and supplemental materi- 
als adopted by the school districts for which they 
are responsible. 

The scope of the project was compressed and 
refined through a series of consultations. Year 1 
activities would concentrate on the instructional 
materials districts had adopted and when; questions 
about adoption processes and professional devel- 
opment would be addressed in year 2. Finally, the 
study would focus on nine grade and content areas: 

• Grade 1 reading, because of the foundational 
importance of early reading. 

• Grade 4 English language arts, because of 
transitions to middle school and historical 
emphasis on testing at this grade level. 

• Grade 8 English language arts, because of 
transitions to high school and historical em- 
phasis on testing at this grade level. 

• Grade 4 math, because of transitions to 
middle school and historical emphasis on test- 
ing at this grade level. 

• Algebra 1, because of its foundational im- 
portance in high school math and the recent 
emphasis on increased rigor in math. 

• Precalculus, because of its importance for 
college readiness and the recent emphasis on 
increased rigor in math. 

• Grade 4 science, because of transitions to 
middle school and historical emphasis on test- 
ing at this grade level. 

• Earth science, because of its foundational 
importance for high school science and the 
recent emphasis on increased rigor in science. 

• Physics, because of its importance for college 
readiness and the recent emphasis on in- 
creased rigor in science. 
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BOX 1 

Study methods 

The research team defined core text 
as the primary textbook adopted for 
instruction in a particular grade and 
content area; adoption and re-adop- 
tion dates as the years in which the 
district school board last adopted and 
will next adopt or renew a core text; 
supplemental materials as additional 
materials adopted to supplement 
instruction; and benchmark assess- 
ments as assessments administered 
to give teachers immediate, forma- 
tive feedback on how students are 
performing. 

The study conducted a census rather 
than a sample survey of instructional 
materials, with the district as the unit 
of analysis, because study requestors 
were interested in the materials ad- 
opted in all districts in their states. 

This report presents results in a 
searchable database that identifies 
materials that have been the sub- 
ject of What Works Clearinghouse 
reports. It provides descriptive 
information about core texts, but low 
item response rates preclude present- 
ing similar information on dates of 
adoption, supplemental materials, 
and benchmark assessments. 

Conducting the census. The census 
was conducted in March-September 
2009. The research team identified 
eligible districts from state educa- 
tion agency lists of districts in each 
jurisdiction for 2008/09 (a total of 
1,162 districts). Once 27 nonoperating 
districts and 22 districts for students 
with disabilities (the focus of the 
study was general education) were 
removed, 1,113 eligible districts re- 
mained, and 90 percent (997) of them 
provided at least some data. 



Letters were sent to superintendents 
of eligible districts (appendix B) 
inviting them to participate in the in- 
ventory, and to curriculum directors, 
asking them to supply information 
on core texts, supplemental mate- 
rial, and benchmark assessments, as 
guided by an enclosed “frequently 
asked questions” document (appen- 
dix C). Curriculum directors were 
asked about the most commonly 
used materials in general education 
courses across all schools in the dis- 
trict. The number of follow-up con- 
tacts for incomplete or unresponsive 
districts ranged from 0 to 22, with an 
average of 6 contacts per district. 

High response rates were anticipated 
because states require school boards 
to periodically adopt or re-adopt 
curricula. In practice, while district 
staff were cooperative, many had dif- 
ficulty generating the requested data, 
for reasons ranging from the press 
of day-to-day responsibilities to the 
many small districts in New Jersey and 
Pennsylvania, whose central offices 
often had no record of adopted cur- 
ricula and referred the research team 
to school principals. The unit response 
rate was 90 percent (see table), lower 
than the 95 percent anticipated. Only 
14 nonresponding districts (1.3 percent 
of eligible districts) declined to partici- 
pate (see appendix D for a list of non- 
responding districts). There was little 



apparent difference in the characteris- 
tics of responding and nonresponding 
districts (see table A1 in appendix A). 

Item response rates were far lower, 
ranging from 6 percent to 72 percent. 
Rates were especially low for core 
text adoption and re-adoption dates, 
titles and publishers of supplemental 
materials, and titles and publishers 
of benchmark assessments. Missing 
item rates for all census items are in 
table A4 in appendix A. 

Coding the data. A coding guide 
was used to sort core texts, core text 
adoption dates, supplemental materi- 
als, and benchmark assessments into 
standard categories to facilitate aggre- 
gation across districts and to ensure 
that the data were entered consistently 
into the database (see appendix E). 
Interrater reliability was 89 percent. 

Developing the online database. The 
database allows users to search for 
a specific district. The district page 
displays lists of materials in the 
three content areas, information 
about the district, and demographic 
data. When districts have reported 
instructional materials assessed in 
What Works Clearinghouse reports, a 
hyperlink takes readers to the report. 
Users can also search for specific 
instructional material by title or 
publisher. 



Response rate by jurisdiction, March-September 2009 





Number of 


Districts responding 


Jurisdiction 


eligible districts 


Number 


Percent 


Delaware 


19 


19 


100 


District of Columbia 


1 


1 


100 


Maryland 


24 


21 


88 


New Jersey 


570 


521 


91 


Pennsylvania 


499 


435 


87 


Total 


1,113 


997 


90 



Source: Authors' analysis of the data described in the searchable database. 
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WHAT LANGUAGE ARTS, MATH, AND SCIENCE INSTRUCTIONAL MATERIALS HAVE DISTRICTS ADOPTED? 



This report covers year 1 of the study and looks at 
two research questions: 

• What instructional materials (core texts, 
supplemental materials, and benchmark 
assessments) have districts adopted in nine 
grade and content areas in English language 
arts, math, and science — and when? 

• To what extent have districts adopted materi- 
als that the What Works Clearinghouse has 
found to have positive effects? 

The study methodology is described in box 1 and 
appendix A. 



were shown to have positive effects or potentially 
positive effects. At the time of this study, 26 
percent of reporting districts had adopted one 
or more components (a core text, a workbook, a 
journal, online exercises, or a reference book) of 
at least one of these materials, and 2 percent had 
adopted some component of two of them. Ev- 
eryday Mathematics, published by McGraw Hill, 
was the only one of these materials to be widely 
adopted (24 percent of reporting districts adopt- 
ing some edition of the core text, supplemental 
material, or benchmark assessment associated 
with the curriculum). 



What instructional materials have districts adopted? 



STUDY FINDINGS 

Analysis of the database revealed that few districts 
reported having adopted district-developed core 
text materials (0-2 percent in each grade and con- 
tent area) or no core text materials (0-3 percent). 
More districts (1-14 percent in each grade and 
content area) reported having adopted more than 
one core text, which may include commercially or 
locally developed materials. 

Depending on the grade and content area, 34-64 
percent of reporting districts provided both the 
title and publisher of a single commercially devel- 
oped core text. Districts were most likely to report 
both the title and publisher of core texts in grade 
4 math (64 percent) and algebra 1 (55 percent). 
They were least likely to report them in grade 8 
English language arts (34 percent) and earth sci- 
ence (41 percent). 



Because response rates were low for core text 
adoption and re-adoption dates, supplemental 
materials, and benchmark assessments, responses 
for these fields were entered into the database, but 
frequency counts were not conducted. Nonethe- 
less, the census generated information on titles 
and publishers of core texts that had not previ- 
ously been reported. 

Table 1 shows the number and percentage of 
eligible districts reporting the titles and publish- 
ers of commercially developed core texts; those 
reporting adoption of district-developed materials, 
no materials, and various materials; and those 
reporting no applicable grade or content area, not 
reporting the particular item, or not responding to 
the census. Because New Jersey and Pennsylvania, 
with 96 percent of responding districts, dominate 
regional counts of district-level data, individual 
tables for each state are presented in tables A6-A9 
in appendix A. 



Few districts reported 
having adopted district- 
developed core text 
materials or no core 
text materials. More 
districts reported 
having adopted more 
than one core text 



As of March 1, 2010, the What 
Works Clearinghouse (WWC) 
had issued reports on studies of 
15 of the instructional materials 
identified by districts in Mid- 
Atlantic Region states that had 
met WWC evidence standards 
with or without reservations. In 
10 of these reports, the curricula 



Few districts reported having adopted district- 
developed core text materials (0-2 percent in each 
grade and content area) or no core text materi- 
als (0-3 percent). More districts reported having 
adopted various materials (1-14 percent depend- 
ing on the grade and content area); the practice 
is most common in English language arts (5-14 
percent), less common in science (2-7 percent), 
and least common in math (1-2 percent). 




STUDY FINDINGS 
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TABLE 1 

Core text title and publisher counts reported by districts in the Mid-Atlantic Region ( n = 1,113 eligible 
districts), March-September 2009 



Grade 

and 

content 

area 


Districts 
reporting 
one core 
text title/ 
publisher 
Number Percent 


Districts 
reporting 
district- 
developed 
materials 
Number Percent 


Districts 
reporting 
no materials 
adopted 
Number Percent 


Districts 
reporting 
adoption 
of various 
materials 
Number Percent 


Districts with 
no applicable 
grade or 
content area 
Number Percent 


Districts not 
reporting 
this item 
Number Percent 


Districts not 
responding 
to census 
Number Percent 


Grade 1 reading 


Text 


462 


42 


18 


2 


29 


3 


93 


8 


65 


6 


330 


30 


116 


10 


Publisher 


587 


53 


18 


2 


29 


3 


59 


5 


65 


6 


239 


21 


116 


10 


Grade 4 English language arts 


Text 


467 


42 


16 


1 


26 


2 


120 


11 


65 


6 


303 


27 


116 


10 


Publisher 


593 


53 


16 


1 


26 


2 


84 


8 


65 


6 


213 


19 


116 


10 


Grade 8 English language arts 


Text 


306 


27 


13 


1 


20 


2 


159 


14 


108 


10 


391 


35 


116 


10 


Publisher 


369 


33 


13 


1 


20 


2 


118 


11 


108 


10 


369 


33 


116 


10 


Grade 4 math 


Text 


600 


54 


7 


1 


3 


0 


26 


2 


65 


6 


296 


27 


116 


10 


Publisher 


719 


65 


7 


1 


3 


0 


25 


2 


65 


6 


178 


16 


116 


10 


Algebra 1 


Text 


522 


47 


1 


0 


0 


0 


26 


2 


74 


7 


374 


34 


116 


10 


Publisher 


549 


49 


1 


0 


0 


0 


25 


2 


74 


7 


348 


31 


116 


10 


Precalculus 


Text 


362 


33 


2 


0 


3 


0 


15 


1 


263 


24 


352 


32 


116 


10 


Publisher 


378 


34 


2 


0 


3 


0 


13 


1 


263 


24 


338 


30 


116 


10 


Grade 4 science 


Text 


511 


46 


16 


1 


30 


3 


46 


4 


64 


6 


330 


30 


116 


10 


Publisher 


556 


50 


16 


1 


30 


3 


77 


7 


64 


6 


254 


23 


116 


10 


Earth science 


Text 


370 


33 


5 


0 


6 


1 


33 


3 


123 


11 


460 


41 


116 


10 


Publisher 


403 


36 


5 


0 


6 


1 


25 


2 


123 


11 


435 


39 


116 


10 


Physics 


Text 


375 


34 


6 


1 


6 


1 


19 


2 


254 


23 


337 


30 


116 


10 


Publisher 


383 


34 


6 


1 


6 


1 


17 


2 


254 


23 


331 


30 


116 


10 



Note: Percentages are shares of the total number of eligible districts (1,113); percentages do not always sum to 100 percent because of rounding. 
Source: Authors' analysis of data described in the searchable database. 



Table 2 shows the number and percentage of 
responding districts that reported one com- 
mercially developed core text title, one core text 
publisher, and one core text title/publisher com- 
bination, plus the number of unique responses in 
each instance. In grade 1 reading, for example, 



462 districts reported a total of 43 unique core 
text titles, while 587 districts reported 30 unique 
core text publishers. Thus, although districts 
were more likely to report core text publishers 
than titles, they reported more unique titles than 
unique publishers. 
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Depending on the grade and content area, 34-64 
percent of reporting districts provided both 
the title and the publisher of a single core text. 

In grade 1 reading, for example, 49 percent of 
reporting districts provided both a title and a 
publisher of a core text, for a total of 60 unique 
combinations. Districts were most likely to report 
both the title and publisher of a core text in grade 
4 math (64 percent) and in algebra 1 (55 percent). 
They were least likely to report them in grade 
8 language (34 percent) and earth science (41 
percent). 

Table 2 also shows the number and percentage of 
districts without missing data for both core text 
title and publisher. For example, for grade 1 read- 
ing, 581 of the 932 responding districts offering 
grade 1 reading provided some response for both 
core text title and publisher. Some responded with 
the titles and publishers of commercially devel- 
oped materials, as described above, while others 
reported that they had adopted district-developed 
materials, no materials, or various materials, as 
detailed in table 1. 



What adopted materials have been rated 
positively by the What Works Clearinghouse? 

The What Works Clearinghouse (WWC) reviews 
research on education interventions, primarily 
practices and branded curricula. It has reviewed 
research in four content areas relevant to this 
project: adolescent literacy, which examines mate- 
rials for grades 4-12 (What Works Clearinghouse 
2009a); beginning reading, which examines mate- 
rials for grades K-3 (What Works Clearinghouse 
2009b); elementary school math, which examines 
materials for grades K-5 (What Works Clearing- 
house 2009c); and middle school math, which 
examines materials for grades 6-9 (What Works 
Clearinghouse 2009d). The What Works Clearing- 
house generates full reports only for interventions 
with studies that meet WWC evidence standards 
with or without reservations. (See appendix A for 
details of the search for WWC reports relevant to 
this project.) 



As of March 1, 2010, the What Works Clearing- 
house had issued reports on 15 of the instruc- 
tional materials reported by Mid-Atlantic Region 
districts. In five of these reports, the curricula 
were shown to have no discernible effects on 
student achievement. In the remaining 10 reports, 
however, the curricula were shown to have positive 
effects or potentially positive effects in the studies 
that met WWC standards (table 3). 

At the time of this study, 256 responding districts 
(26 percent) had adopted one or more components 
(core text, workbook, journal, online exercises, 
or reference book) of at least one of these materi- 
als, and 17 districts (2 percent) had adopted some 
component of two of them. Everyday Mathematics, 
published by Wright Group/McGraw Hill, was the 

TABLE 3 

Number of districts reporting adoption of 
instructional materials with positive or potentially 
positive What Works Clearinghouse effectiveness 
ratings, as of March 1, 2010 



Grade, content area, and 
instructional material with What 
Works Clearinghouse rating 


Number 
of districts 
reporting 
adoption 


Literacy 


Grade 1 reading 


Accelerated Reader/Reading Renaissance 


4 


Lexia Reading 


1 


Voyager Universal Literacy System 


1 


Wilson Reading System 


8 


Grade 4 English language arts 


SuccessMaker 


4 


Grade 8 English language arts 


Read 180 


1 


Math 


Grade 4 math 


Everyday Mathematics 


235 


Odyssey Math 


5 


Algebra 1 


Cognitive Tutor Algebra 1 


9 


Saxon Middle School Math 


5 



Source: Authors' analysis of data described in the searchable database; 
What Works Clearinghouse (2009a,b,c,d). 
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only one of these materials to be widely adopted, 
with 235 districts (24 percent) reporting adoption 
of some edition of the core text, some supplemen- 
tal material, or a benchmark assessment associ- 
ated with the curriculum. 



STUDY LIMITATIONS 

Because this was the first year of data collection, 
and many districts did not participate in full, this 
study had several limitations: 



using older materials were less likely to report 
their adoptions. Despite this limitation, 
responding districts provided useful infor- 
mation that can be reviewed as a first step in 
building the descriptive database. 

Database information is static, but materials 
adoption is dynamic, with districts frequently 
adopting new materials. A regularly updated 
database would provide more timely, relevant, 
and useful information. Plans for year 2 ad- 
dress this problem. 



• Low response rates for core text adoption 
and re-adoption dates, supplemental materi- 
als, and benchmark assessments prevented 
data compilation for those fields. Even items 
for which data were compiled — core text 
title and publisher — had fairly high average 
item nonresponse rates (48 percent and 43 
percent) across the nine grade and content 
areas. Plans for year 2 address this problem 
(see below). 



• Follow-up processes differed for data collec- 
tion, concentrating initially on districts with 
incomplete data and later on nonresponding 
districts. This shift might have led to variation 
in data completeness. 



Everyday Mathematics 
was the only instructional 
material with a positive 
or potentially positive 
rating to be widely 
adopted, with 235 
districts reporting 
adoption of some 
edition of the core text, 
some supplemental 
material, or a benchmark 
assessment associated 
with the curriculum 



Earth science data might be underreported 
because the content is taught under a variety 
of course titles (such as earth 
science, earth and space, and 
introduction to science), and some 
district staff might not have re- 
ported materials for courses other 
than those named “earth science,” 
the title requested in census in- 
structions. Plans for year 2 address 
this problem. 



Generalizing from data in the 
database to all eligible dis- 
tricts in a state or the region 
is inappropriate. It is possible, 
for example, that districts 



• A district’s adoption of particular curricular 

materials does not indicate actual use in the 
classroom, nor does the popularity of par- 
ticular curricular materials indicate anything 
about effectiveness. 



RECOMMENDED CHANGES FOR YEAR 2 

Based on the experience in year 1 of the study, 
the research team recommends several changes 
for year 2, subject to approval by the Institute for 
Education Sciences: 

• Address research questions that were specified 
in the project plan but not dealt with in year 1: 
analyses of adoption processes and amounts 
of professional development. 

• Improve response rates and accuracy by 
providing districts with lists of commonly 
adopted materials for each grade and content 
area and asking them to check the items they 
have adopted, fill in complete data if they 
have adopted unlisted materials, or check 
options indicating that they have adopted 

no materials or do not offer the grade and 
content area. 

• Improve introductory letters and the fre- 
quently asked questions enclosure, specifying 
more clearly which data to submit and how to 
report that no materials have been adopted in 
a particular category. 




RECOMMENDED CHANGES FOR YEAR 2 
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Improve the consistency and organization of 
the coding guide. 

Refine the coding guide to specify the types of 
materials adopted (such as websites, math ma- 
nipulatives, technology applications, language 
arts anthologies, and integrated instructional 
materials). 



• Refine the coding guide to resolve weighting 
issues, where feasible, when districts report 
more than one item in a given category (for 
example, four supplemental materials in 
grade 4 math). 

• Develop a database capability to enable users 
to export data for their own purpose. 
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APPENDIX A 

DATA SOURCES AND METHODS 

Of a list of all 1,162 districts in the region compiled 
from state education agency lists, 22 primarily for 
students with disabilities and 27 in New Jersey 
with no schools or students were removed, leaving 
1,113 eligible districts. 

The Office of Management and Budget provided 
clearance for this project (see box Al). 

Conducting the census 

Data collection to meet state education agency 
requests for details on instructional materials 
adopted by all districts in their jurisdictions was 
based on a complete census rather than a sample 
survey. A database containing only some of the 
districts in a state, even if they were representative 
of key district characteristics, would not serve that 
purpose. 

Letters first announced the project to all chief state 
school officers in the region and then to superin- 
tendents of all districts, encouraging them to par- 
ticipate in the census (appendix B). Next, letters 
requesting specific data were sent to all curricu- 
lum directors, along with a summary table listing 

BOX A1 

Office of Management and Budget burden 
statement for the instructional materials data 
collection 

According to the Paperwork Reduction Act of 1995, no 
persons are required to respond to a collection of infor- 
mation unless such a collection displays a valid Office of 
Management and Budget (OMB) control number. The 
valid OMB control number for this information collec- 
tion is 1850-0862. The time required to provide the re- 
quested information is estimated to average a maximum 
of 30 minutes. If you have any comments concerning 
the accuracy of the time estimate(s) or suggestions for 
improving this form, please write to: U.S. Department of 
Education, Washington, D.C. 20202-4537. 



the information sought and a frequently asked 
questions document (appendix C). Districts that 
did not respond were contacted by phone, email, 
or fax. To improve data collection in New Jersey 
and Pennsylvania, letters of support were obtained 
from the New Jersey School Boards Association 
and the Pennsylvania School Boards Association 
in June 2009 and cited in subsequent contacts with 
districts. 

All eligible districts were contacted at least once. 
Districts that did not respond initially were 
contacted until they provided the requested ma- 
terials, 3 they declined to participate, or the data 
collection period ended. When early follow-up 
phone calls showed that districts stored data on 
instructional materials in a variety of places (for 
example, in offices of curriculum directors, prin- 
cipals, or content area supervisors), subsequent 
initial contacts were modified to include questions 
about whom to talk to. All communications and 
data were centrally tracked to document progress. 
Communication logs included the name of the 
person contacted, the interviewer, the date, and 
the time of each interaction. 



Coding the data 

Three coders reviewed and coded incoming data 
using a project coding guide to ensure that reli- 
able and valid data were entered into the database 
(see appendix E). Because some responses were 
open to varying interpretation, the coding guide 
emphasized relying on the integrity of the data as 
reported by the district to avoid misreporting of 
responses; thus, corrections to district data con- 
sisted chiefly of correcting spelling, standardizing 
orthography (for example, changing “pre-calculus” 
to “precalculus” and “&” to “and”), and distribut- 
ing combined responses into appropriate fields in 
the database. (For example, if a district reported 
“Pearson Prentice Hall: Algebra 1, 2007,” the coder 
would enter the title as “Algebra 1,” the publisher 
as “Pearson Prentice Hall,” and the publication 
date as “2007”) Interrater reliability tests, per- 
formed on approximately 10 percent of responses, 
yielded an 89 percent reliability rating. Coders 
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entered all data into an online application. Once 
data entry was complete, the data were exported 
to a spreadsheet and systematically reviewed for 
validity and typographical errors. All changes 
were documented in a notes section of the online 
application. This process yielded seven categories 
of district responses (table Al). 

Variations in how districts reported titles and pub- 
lishers of core texts presented coding challenges. 
For example, coders found the same core text 
title described as “Houghton Mifflin Math, 2005,” 
“Houghton Math, 2005,” “Mathematics, 2005” and 
“Houghton Mifflin, 2005.” Publisher names were 
an even greater challenge. Not only did districts 
report them in various forms, but names changed 
with mergers and divestitures. Thus, the same title 
might be offered by more than one publisher over 
a few years. In some cases, coders could not tell 
whether districts were reporting the same core 
text title and publisher. Because of the difficulty 
of resolving such issues without recontacting the 
districts, coders were directed to enter publisher 
names exactly as reported by districts, except for 
correcting misspellings, making names consistent 
(for example, entering “John Wiley” as “Wiley”), 
separating combined responses into appropri- 
ate fields in the database, and substituting the 
publisher name where districts reported the 
name of an imprint of the publisher (for example, 



“Harcourt School Publishers” is an imprint of the 
publisher “Harcourt”). 

Coders were also instructed not to infer a book 
title when a district provided only a publisher 
name, not to infer a publisher when a district 
provided only a title, and not to infer a publication 
date when a district did not provide one. 

Another problem was how to code reports of 
multiple materials for a single grade and content 
area, such as two core texts for grade 8 math or 20 
supplementary materials for grade 4 language arts, 
with no indication of how much each was used. 
Entering all such items into the database would 
overrepresent their prevalence across districts, 
because each of the 20 supplementary materials in 
one district would have the same weight as a single 
supplementary material in another district. But 
not entering multiple materials into the database 
would underrepresent their prevalence because 
there would be no record of the reporting district’s 
adoption of the material. Coders were instructed 
to enter only single core texts or supplementary 
materials into the database and to enter “various 
materials” for districts reporting multiple (de- 
fined as more than one) materials. This decision 
recognized that year 1 data collection served in 
part to make the research team aware of the kinds 
of responses districts would make and to prepare 



TABLE Al 

Categories of instructional materials, March-September 2009 



Category 


Description 


One commercially developed 
material 


Used when the district reported adopting one commercially developed material. The title is 
listed in the database in these cases. 


District-developed materials 


Used when the district developed and adopted its own materials. 


None adopted 


Used when the district specifically reported that no materials were adopted for that grade 
and content area. 


Various materials 


Used when more than one item was reported by a district for one grade and content area. 
These individual materials were not coded and are not included in the database. 


Not applicable 


Used when the district did not contain grade levels applicable to the data requested (for 
example, grade 8 language arts literacy in a K-6 district) or when the district reported that a 
content area was not offered in the district. 


Not reported 


Used when the district provided no response for a given item (item nonresponse). 


No response 


Used when the district did not respond to any items (unit nonresponse). 



Source: Authors' analysis of data described in the searchable database. 
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plans for more complete and efficient data collec- 
tion in year 2. 

Finally, coders were instructed to code a response 
as “none adopted” only when the district specifi- 
cally reported that no materials were adopted for 
that grade and content area. However, some dis- 
tricts might have indicated that they had adopted 
no materials by leaving the response blank, which 
coders were instructed to enter as “not reported.” 
Thus, the “not reported” category could include 
some districts with no adopted curriculum in a 
particular grade and content area; these should 
have been coded as “none adopted.” 

For more detailed information about coding, see 
appendix E, the coding guide used in year 1, and 
appendix F, the revised coding guide for year 2. 

Analyzing the results 

Of the 1,113 eligible districts, 997 responded to the 
inventory, resulting in a unit response rate of 90 
percent, somewhat below the 95 percent antici- 
pated. There was little apparent difference in the 
characteristics of responding and nonresponding 
districts (table A2; see below for a discussion of 
how district-level demographic characteristics 
were derived from the National Center for Educa- 
tion Statistics Common Core of Data). 

More problematic were the low item-level re- 
sponse rates for many census fields, particularly 
for adoption dates, supplemental materials, and 
benchmark assessments. One reason for the low 
item-level response rates is that many responding 
districts, particularly in New Jersey, did not have 
schools with all the grades for which the study 
sought data. In such instances, the database lists 
“not applicable” in the corresponding field. Table 
A3 presents counts of eligible districts responding 
and not responding to the census by grade span 
and state. 

Another reason for low item response rates is that 
many districts provided information for some of 



TABLE A2 

Characteristics of responding and nonresponding 
districts, March-September 2009 



Characteristic 


Responding 

districts 


Nonresponding 

districts 


Average number of 






students per district 


3,729 


3,490 


Race/ethnicity (average percent of students) 


American Indian/ 






Alaska Native 


0 


0 


Asian/Pacific Islander 


4 


3 


Hispanic 


8 


9 


Black, non-Hispanic 


10 


8 


White, non-Hispanic 


79 


80 


Socioeconomic status (average percent of students) 


Eligible for free or 






reduced-price meals 


24 a 


28 


Locale (percent of districts) 


City 


3 


1 


Suburb 


59 


55 


Town 


12 


12 


Rural 


26 


32 



a. No data were available for 26 of the 997 responding districts. 
Source: U.S. Department of Education 2007a, b. 



their grade and content areas or for some materi- 
als within grade and content areas but not others 
(table A4). For these instances, the database lists 
“not reported.” Item-level missing data rates for 
the region were calculated by adding the 116 
districts that did not respond at all to the data 
collection to the total number of “not reported” 
responses for that item and dividing the total by 
the number of eligible districts (1,113) minus the 
count of “not applicable” districts for that item. 

For example, for grade 1 reading, 116 districts did 
not respond to the data collection and 330 districts 
did not report information on that item, for a total 
of 446. This number is divided by the total count 
of eligible districts (1,113) minus the count of dis- 
tricts that did not teach grade 1 reading (65 “not 
applicable” districts) to equal 43 percent. 

116 + 330 

=43% 

1,113-65 
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TABLE A3 

Count of eligible districts responding and not responding to the census, by grade range and jurisdiction, 
March-September 2009 



Delaware 


District of 
Columbia 


Maryland 


New Jersey 


Pennsylvania 


Total 


(19 districts) 


(1 district) 


(24 districts) 


(570 districts) 


(499 districts) 


(1,113 districts) 


Grade Not 


Not 


Not 


Not 


Not 


Not 


range Responding responding Responding responding Responding responding Responding responding Responding responding Responding responding 



1-8 














1 


0 






1 


0 

— 


6-12 


1 


0 










1 


0 






2 


0 


7-12 














14 


2 






14 


2 


9-12 


3 


0 










46 


4 






49 


4 


10-12 














1 


0 






1 


0 


K-4 














1 


0 






1 


0 


K-6 














25 


1 






25 


1 


K-8 














89 


10 


1 


0 


90 


10 


K-9 














0 


1 






0 


1 


K— 1 1 














1 


0 






1 


0 


K-12 














78 


5 


391 


57 


469 


62 


PreK-5 














1 


0 






1 


0 


PreK-6 














32 


3 






32 


3 


PreK-8 














105 


13 


1 


0 


106 


13 


PreK-12 


15 


0 


1 


0 


21 


3 


126 


10 


42 


7 


205 


20 


Total 


19 


0 


1 


0 


21 


3 


521 


49 


435 


64 


997 


116 



Source: Authors' analysis of data described in the searchable database. 



Average item-level missing data rates for date of 
core text adoption and re-adoption, supplemen- 
tal materials title and publisher, and benchmark 
assessment title and publisher were 75 percent or 
higher (see table A4). For these fields, responses 
were entered into the database, but frequency 
counts were not conducted. Missing data rates 
for core text title (48 percent) and publisher (43 
percent) were somewhat better (see table A4). For 
these fields, the research team entered responses 
into the database and generated frequencies by 
jurisdiction but avoided making inferences or 
generalizations based on the data. 

Table A5 shows missing data rates for core text 
title and publisher in each jurisdiction. 

Table 1 in the main report shows the number 
and percentage of eligible districts reporting the 
titles and publishers of commercially developed 



core texts; those reporting adoption of district- 
developed materials, no materials, and various 
materials; and those reporting no applicable grade 
or content area, not reporting the particular item, 
or not responding to the census. Tables A6-A9 
show the same data for each state (the District of 
Columbia is not shown because it includes only 
one school district). 

Developing the online database 

All data were imported into the IBM* SPSS* 
Statistics program, and frequency analyses were 
run for each data item to obtain counts for each 
material category (one commercial title, district- 
developed, none adopted, various adopted, not 
applicable, not reported, or no response) by grade 
and content area. Unique combinations of com- 
mercial titles and publishers were entered into 
the project’s Database of Selected Language Arts 
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TABLE A4 

Item-level missing data rates in the Mid-Atlantic Region, March-September 2009 (percent) 







Core text 




Supplemental materials 


Benchmark assessment 


Grade and 
content area 


Title 


Publisher 


Date of 
adoption 


Date of 
re-adoption 


Title 


Publisher 


Title 


Publisher 


Literacy 


Grade 1 reading 


43 


34 


70 


80 


79 


80 


80 


80 


Grade 4 English 
language arts 


40 


31 


70 


80 


79 


81 


81 


81 


Grade 8 English 
language arts 


50 


48 


77 


84 


80 


81 


84 


84 



Math 



Grade 4 math 


39 


28 


69 


79 


87 


87 


83 


83 


Algebra 1 


47 


45 


75 


83 


93 


93 


87 


86 


Precalculus 


55 


53 


78 


85 


94 


94 


89 


89 



Science 



Grade 4 science 


43 


35 


75 


82 


85 


86 


90 


90 


Earth science 


58 


56 


80 


86 


94 


94 


93 


93 


Physics 


53 


52 


77 


84 


94 


94 


92 


92 


Average 


48 


43 


75 


83 


87 


88 


87 


86 



Source: Authors' analysis of data described in the searchable database. 



TABLE A5 

Item-level missing data rates for core text title and publisher, by jurisdiction and grade and content areas, 
March-September 2009 (percent) 



Grade and 
content area 


Delaware 
Core text Core text 

title publisher 


District of 
Columbia 
Core text Core text 

title publisher 


Maryland 
Core text Core text 

title publisher 


New Jersey 
Core text Core text 

title publisher 


Pennsylvania 
Core text Core text 

title publisher 


Literacy 


Grade 1 reading 


25 


19 


0 


0 


38 


42 


38 


32 


48 


36 


Grade 4 English 






















language arts 


25 


13 


0 


0 


42 


46 


32 


25 


48 


38 


Grade 8 English 






















language arts 


29 


24 


100 


100 


50 


46 


40 


40 


61 


57 


Math 


Grade 4 math 


6 


6 


0 


0 


25 


25 


31 


20 


49 


37 


Algebra 1 


26 


16 


100 


100 


33 


33 


43 


40 


53 


51 


Precalculus 


21 


16 


100 


100 


33 


33 


50 


49 


60 


58 


Science 


Grade 4 science 


13 


19 


0 


0 


35 


39 


37 


30 


50 


42 


Earth science 


33 


33 


100 


100 


45 


45 


56 


54 


61 


58 


Physics 


32 


26 


100 


100 


42 


46 


46 


46 


58 


57 


Average 


23 


19 


56 


56 


38 


39 


42 


37 


54 


48 



Source: Authors' analysis of data described in the searchable database. 
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TABLE A6 

Core text title and publisher counts in Delaware by grade and content area, March-September 2009 (n = 19 
eligible districts) 



Grade 

and 

content 

area 


Districts 
reporting 
one core 
text title/ 
publisher 
Number Percent 


Districts 
reporting 
district- 
developed 
materials 
Number Percent 


Districts 
reporting 
no materials 
adopted 
Number Percent 


Districts 
reporting 
adoption 
of various 
materials 
Number Percent 


Districts with 
no applicable 
grade or 
content area 
Number Percent 


Districts not 
reporting 
this item 
Number Percent 


Districts not 
responding 
to census 
Number Percent 


Grade 1 reading 


Text 


12 


63 


0 


0 


0 


0 


0 


0 


3 


16 


4 


21 


0 


0 


Publisher 


13 


68 


0 


0 


0 


0 


0 


0 


3 


16 


3 


16 


0 


0 


Grade 4 English language arts 


Text 


11 


58 


0 


0 


0 


0 


1 


5 


3 


16 


4 


21 


0 


0 


Publisher 


13 


68 


0 


0 


0 


0 


1 


5 


3 


16 


2 


11 


0 


0 


Grade 8 English language arts 


Text 


11 


58 


0 


0 


0 


0 


1 


5 


2 


11 


5 


26 


0 


0 


Publisher 


12 


63 


0 


0 


0 


0 


1 


5 


2 


11 


4 


21 


0 


0 


Grade 4 math 


Text 


14 


74 


0 


0 


0 


0 


1 


5 


3 


16 


1 


5 


0 


0 


Publisher 


14 


74 


0 


0 


0 


0 


1 


5 


3 


16 


1 


5 


0 


0 


Algebra 1 


Text 


13 


68 


0 


0 


0 


0 


1 


5 


0 


0 


5 


26 


0 


0 


Publisher 


16 


84 


0 


0 


0 


0 


0 


0 


0 


0 


3 


16 


0 


0 


Precalculus 


Text 


13 


68 


1 


5 


0 


0 


1 


5 


0 


0 


4 


21 


0 


0 


Publisher 


14 


74 


1 


5 


0 


0 


1 


5 


0 


0 


3 


16 


0 


0 


Grade 4 science 


Text 


11 


58 


0 


0 


0 


0 


3 


16 


3 


16 


2 


11 


0 


0 


Publisher 


8 


42 


0 


0 


0 


0 


5 


26 


3 


16 


3 


16 


0 


0 


Earth science 


Text 


9 


47 


0 


0 


1 


5 


2 


11 


1 


5 


6 


32 


0 


0 


Publisher 


9 


47 


0 


0 


1 


5 


2 


11 


1 


5 


6 


32 


0 


0 


Physics 


Text 


12 


63 


0 


0 


0 


0 


1 


5 


0 


0 


6 


32 


0 


0 

— 


Publisher 


13 


68 


0 


0 


0 


0 


1 


5 


0 


0 


5 


26 


0 


0 



Note: Percentages are shares of the total number of eligible districts (19); percentages do not always sum to 100 percent because of rounding. 
Source: Authors' analysis of data described in the searchable database. 
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TABLE A7 

Core text title and publisher counts in Maryland by grade and content area, March-September 2009 (n = 24 
eligible districts) 



Grade 

and 

content 

area 


Districts 
reporting 
one core 
text title/ 
publisher 
Number Percent 


Districts 
reporting 
district- 
developed 
materials 
Number Percent 


Districts 
reporting 
no materials 
adopted 
Number Percent 


Districts 
reporting 
adoption 
of various 
materials 
Number Percent 


Districts with 
no applicable 
grade or 
content area 
Number Percent 


Districts not 
reporting 
this item 
Number Percent 


Districts not 
responding 
to census 
Number Percent 


Grade 1 reading 


Text 


10 


42 


0 


0 


0 


0 


5 


21 


0 


0 


6 


25 


3 


13 


Publisher 


12 


50 


0 


0 


0 


0 


2 


8 


0 


0 


7 


29 


3 


13 


Grade 4 English language arts 


Text 


10 


42 


0 


0 


0 


0 


4 


17 


0 


0 


7 


29 


3 


13 


Publisher 


11 


46 


0 


0 


0 


0 


2 


8 


0 


0 


8 


33 


3 


13 


Grade 8 English language arts 


Text 


10 


42 


0 


0 


0 


0 


2 


8 


0 


0 


9 


38 


3 


13 


Publisher 


11 


46 


0 


0 


0 


0 


2 


8 


0 


0 


8 


33 


3 


13 


Grade 4 math 


Text 


14 


58 


1 


4 


1 


4 


2 


8 


0 


0 


3 


13 


3 


13 


Publisher 


14 


58 


1 


4 


1 


4 


2 


8 


0 


0 


3 


13 


3 


13 


Algebra 1 


Text 


16 


67 


0 


0 


0 


0 


0 


0 


0 


0 


5 


21 


3 


13 


Publisher 


16 


67 


0 


0 


0 


0 


0 


0 


0 


0 


5 


21 


3 


13 


Precalculus 


Text 


16 


67 


0 


0 


0 


0 


0 


0 


0 


0 


5 


21 


3 


13 


Publisher 


16 


67 


0 


0 


0 


0 


0 


0 


0 


0 


5 


21 


3 


13 


Grade 4 science 


Text 


9 


38 


1 


4 


2 


8 


3 


13 


1 


4 


5 


21 


3 


13 


Publisher 


9 


38 


1 


4 


2 


8 


2 


8 


1 


4 


6 


25 


3 


13 


Earth science 


Text 


11 


46 


0 


0 


1 


4 


0 


0 


2 


8 


7 


29 


3 


13 


Publisher 


11 


46 


0 


0 


1 


4 


0 


0 


2 


8 


7 


29 


3 


13 


Physics 


Text 


13 


54 


0 


0 


0 


0 


1 


4 


0 


0 


7 


29 


3 


13 

— 


Publisher 


13 


54 


0 


0 


0 


0 


0 


0 


0 


0 


8 


33 


3 


13 



Note: Percentages are shares of the total number of eligible districts (24); percentages do not always sum to 100 percent due to rounding. 
Source: Authors' analysis of data described in the searchable database. 
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TABLE A8 

Core text title and publisher counts in New Jersey by grade and content area, March-September 2009 
(n = 570 eligible districts) 



Grade 

and 

content 

area 


Districts 
reporting 
one core 
text title/ 
publisher 
Number Percent 


Districts 
reporting 
district- 
developed 
materials 
Number Percent 


Districts 
reporting 
no materials 
adopted 
Number Percent 


Districts 
reporting 
adoption 
of various 
materials 
Number Percent 


Districts with 
no applicable 
grade or 
content area 
Number Percent 


Districts not 
reporting 
this item 
Number Percent 


Districts not 
responding 
to census 
Number Percent 


Grade 1 reading 


Text 


224 


39 


11 


2 


11 


2 


70 


12 


62 


11 


143 


25 


49 


9 


Publisher 


281 


49 


11 


2 


11 


2 


44 


8 


62 


11 


112 


20 


49 


9 


Grade 4 English language arts 


Text 


240 


42 


10 


2 


12 


2 


81 


14 


62 


11 


116 


20 


49 


9 


Publisher 


302 


53 


10 


2 


12 


2 


56 


10 


62 


11 


79 


14 


49 


9 


Grade 8 English language arts 


Text 


148 


26 


9 


2 


9 


2 


111 


19 


106 


19 


138 


24 


49 


9 


Publisher 


179 


31 


9 


2 


9 


2 


82 


14 


106 


19 


136 


24 


49 


9 


Grade 4 math 


Text 


330 


58 


3 


1 


0 


0 


16 


3 


62 


11 


110 


19 


49 


9 


Publisher 


387 


68 


3 


1 


0 


0 


16 


3 


62 


11 


53 


9 


49 


9 


Algebra 1 


Text 


272 


48 


1 


0 


0 


0 


12 


2 


74 


13 


162 


28 


49 


9 


Publisher 


285 


50 


1 


0 


0 


0 


11 


2 


74 


13 


150 


26 


49 


9 


Precalculus 


Text 


151 


26 


1 


0 


0 


0 


6 


1 


252 


44 


111 


19 


49 


9 


Publisher 


155 


27 


1 


0 


0 


0 


5 


1 


252 


44 


108 


19 


49 


9 


Grade 4 science 


Text 


277 


49 


7 


1 


11 


2 


28 


5 


59 


10 


139 


24 


49 


9 


Publisher 


295 


52 


7 


1 


11 


2 


47 


8 


59 


10 


102 


18 


49 


9 


Earth science 


Text 


177 


31 


3 


1 


2 


0 


19 


3 


111 


19 


209 


37 


49 


9 


Publisher 


192 


34 


3 


1 


2 


0 


14 


2 


111 


19 


199 


35 


49 


9 


Physics 


Text 


159 


28 


2 


0 


1 


0 


10 


2 


252 


44 


97 


17 


49 


9 

— 


Publisher 


157 


28 


2 


0 


1 


0 


11 


2 


252 


44 


98 


17 


49 


9 



Note: Percentages are shares of the total number of eligible districts (570); percentages do not always sum to 100 percent because of rounding. 
Source: Authors' analysis of data described in the searchable database. 
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TABLE A9 

Core text title and publisher counts in Pennsylvania by grade and content area, March-September 2009 
(n = 499 eligible districts) 



Grade 

and 

content 

area 


Districts 
reporting 
one core 
text title/ 
publisher 
Number Percent 


Districts 
reporting 
district- 
developed 
materials 
Number Percent 


Districts 
reporting 
no materials 
adopted 
Number Percent 


Districts 
reporting 
adoption 
of various 
materials 
Number Percent 


Districts with 
no applicable 
grade or 
content area 
Number Percent 


Districts not 
reporting 
this item 
Number Percent 


Districts not 
responding 
to census 
Number Percent 


Grade 1 reading 


Text 


216 


43 


7 


1 


18 


4 


17 


3 


0 


0 


177 


35 


64 


13 


Publisher 


281 


56 


7 


1 


18 


4 


12 


2 


0 


0 


117 


23 


64 


13 


Grade 4 English language arts 


Text 


206 


41 


6 


1 


14 


3 


33 


7 


0 


0 


176 


35 


64 


13 


Publisher 


267 


54 


6 


1 


14 


2 


24 


5 


0 


0 


124 


25 


64 


13 


Grade 8 English language arts 


Text 


137 


27 


4 


1 


11 


2 


45 


9 


0 


0 


238 


48 


64 


13 


Publisher 


167 


33 


4 


1 


11 


2 


33 


7 


0 


0 


220 


44 


64 


13 


Grade 4 math 


Text 


241 


48 


3 


1 


2 


0 


7 


1 


0 


0 


182 


36 


64 


13 


Publisher 


303 


61 


3 


1 


2 


0 


6 


1 


0 


0 


121 


24 


64 


13 


Algebra 1 


Text 


221 


44 


0 


0 


0 


0 


13 


3 


0 


0 


201 


40 


64 


13 


Publisher 


232 


46 


0 


0 


0 


0 


14 


3 


0 


0 


189 


38 


64 


13 


Precalculus 


Text 


182 


36 


0 


0 


3 


1 


8 


2 


11 


2 


231 


46 


64 


13 


Publisher 


193 


39 


0 


0 


3 


1 


7 


1 


11 


2 


221 


44 


64 


13 


Grade 4 science 


Text 


213 


43 


8 


2 


17 


3 


12 


2 


1 


0 


184 


37 


64 


13 


Publisher 


243 


49 


8 


2 


17 


3 


23 


5 


1 


0 


143 


29 


64 


13 


Earth science 


Text 


173 


35 


2 


0 


2 


0 


12 


2 


9 


2 


237 


47 


64 


13 


Publisher 


191 


38 


2 


0 


2 


0 


9 


2 


9 


2 


222 


44 


64 


13 


Physics 


Text 


191 


38 


4 


1 


5 


1 


7 


1 


2 


0 


226 


45 


64 


13 

— 


Publisher 


200 


40 


4 


1 


5 


1 


5 


1 


2 


0 


219 


44 


64 


13 



Note: Percentages are shares of the total number of eligible districts (499); percentages do not always sum to 100 percent because of rounding. 
Source: Authors' analysis of data described in the searchable database. 
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Literacy, Mathematics, and Science Instructional 
Materials in the Mid-Atlantic Region (described 
fully in appendix G and available at http://www. 
relmid-atlantic.org/ci). 

The database allows users (such as state and 
local policymakers, practitioners, parents, and 
researchers) to search for a specific district by 
selecting from dropdown menus of states, coun- 
ties, and districts. The district page displays a list 
of materials in the three content areas, informa- 
tion about the district (state, county, and grade 
range), and demographic data from the NCES 
Common Core of Data (U.S. Department of Edu- 
cation 2007a), such as enrollment, race/ethnicity, 
and percentage of students eligible for free or 
reduced-price meals. Users can also search for an 
instructional material by title and publisher and 
retrieve a list of all districts that reported adopt- 
ing it; query the database for a list of districts 
that reported other categories of data, including 
none adopted, various adopted, not applicable, 
and no response; and then select an individual 
district, which will take them to the district page 
described above. 

Instructional materials that have been evaluated in 
WWC reports include a hyperlink to the report so 
that database users can review conclusions about 
the materials’ effectiveness. As more materials are 
reviewed by the What Works Clearinghouse, the 
database will be updated. 

The database explains how to submit corrections 
for errors that district staff find in their data. 



Collecting information from the What Works 
Clearinghouse and information on district- 
level demographic characteristics 

What Works Clearinghouse reports. To assess 
whether districts are implementing evidence- 
based programs, the research team obtained 
information from the WWC website (http://www. 
whatworks.ed.gov). As of March 1, 2010, the site 
featured reviews of materials in four areas related 
to the data collected in this project: elementary 



school math, middle school math, beginning read- 
ing, and adolescent literacy. 

The research team examined all topic reports in 
these four areas; identified interventions reported 
to have positive or potentially positive effects in at 
least one domain (beginning reading, for example, 
has four domains: alphabetics, reading fluency, 
comprehension, and general reading achievement); 
and searched the project database to identify all 
districts that had reported adopting materials as- 
sociated with these interventions. 

For one intervention, University of Chicago 
School Mathematics Project (UCSMP) Algebra, 
the WWC website contains a July 2007 report 
concluding that it had potentially positive effects 
and a March 2009 report that it had no discernible 
effects. WWC staff confirmed that the 2009 report 
“includes the most recent research on the program 
within the parameters of the current WWC Mid- 
dle School Math protocol” (email communication, 
April 2, 2010). Thus, the research team excluded 
UCSMP Algebra from its fist of instructional mate- 
rials with positive or potentially positive ratings 
(see table 3 in the main report). 

District-level demographic data. Data on districts’ 
locale, grade range, English language learner stu- 
dent enrollment, and special education enrollment 
were obtained from the Common Core of Data 
Local Education Agency Universe Survey 2006-07 
data file (U.S. Department of Education 2007b). 
Data on a district’s racial/ethnic enrollment and 
free or reduced-price meals enrollment were 
obtained from the 2006-07 Elementary/Secondary 
School Universe Survey data file (U.S. Department 
of Education 2007a). 

Total district enrollment was obtained by cal- 
culating the sum of the total school enrollment 
field for all schools in a given district from the 
Elementary/Secondary School Universe Survey 
2006-07 data file and also from the total district 
enrollment field in the Local Education Agency 
Universe Survey data file. The two sources 
produced identical values for 624 of the 1,113 
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operating districts but different values for the 
remaining 489. For consistency, and because the 
majority of district-level demographic data were 
obtained from the Elementary/Secondary School 
Universe Survey data file, that source was used 
in calculating total district enrollment. The total 
district enrollment field from the Local Educa- 
tion Agency Universe Survey data file was used 
only when calculating the percentages of English 
language learner students and special education 
students. 

The percentage of student enrollment by race/ 
ethnicity was calculated by summing enrollment 
for each racial/ethnic category for all schools in a 
district and dividing each category total by total 
district enrollment. Total district enrollment was 
calculated as described above, from data in the El- 
ementary/Secondary School Universe Survey data 
file. The same procedure was followed to calculate 
the percentage of students in each district eligible 
for free or reduced-price meals. 

The percentages of English language learner 
students and students receiving special education 
services were calculated in the same way, but with 



data from the Local Education Agency Universe 
Survey data file. 

Finally, district locale data were converted from 
the 12 district-level locale fields to 4 aggregated 
fields, as follows: 

• If the locale field contained “city, large terri- 
tory,” “city, mid-size territory,” or “city, small 
territory,” the district was considered to be 
located in a city. 

• If the locale field contained “suburb, large 
territory,” “suburb, mid-size territory,” or 
“suburb, small territory,” the district was 
considered to be located in a suburb. 

• If the locale field contained “town, fringe 
territory,” “town, distant territory,” or “town, 
remote territory,” the district was considered 
to be located in a town. 

• If the locale field contained “rural, fringe 
territory,” “rural, distant territory,” or “rural, 
remote territory,” the district was considered 
to be located in a rural area. 
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APPENDIX B 

SAMPLE INTRODUCTORY LETTER TO 
CHIEF SCHOOL ADMINISTRATORS 

Dear Superintendent: 

The Regional Educational Laboratory Mid-Atlantic is embarking on a valuable new enterprise. This pioneering 
initiative will inventory and document a selection of adopted language arts literacy, math, and science materials in 
all districts within the Mid-Atlantic region. This enterprise will, when complete, prove immediately useful to you 
and other decision makers in your district. 

Data collected will be made available to all educators in the region through two products: 1) a descriptive report 
that provides information about the frequency with which these materials are adopted across the region and 2) an 
interactive, online, and publicly accessible database. District and school personnel will be able to use this informa- 
tion to find out what materials other districts in the region have adopted and which ones are supported by scien- 
tifically-based research. District names and the materials they have adopted will be viewable in the online tool. 
District names will not be used in the written report; only aggregate data will be presented. No individual district 
staff names will be used in either product. 

Within the next week, we will be sending a letter to your Curriculum Director with a request for a list of the names 
of adopted core texts, supplemental materials, associated benchmark assessments, and the dates of adoption, for 
each of the following grades and content areas: 

Math: Grade 4, Algebra 1, and Precalculus 

Science: Grade 4, Earth Science, and Physics 
Literacy: Grade 1, Grade 4, and Grade 8 

We will make every effort to minimize the burden on district staff. Districts will be contacted in a few weeks to 
answer any questions you might have. In the meantime, if you have any questions please contact Ryan Casey, Pro- 
gram Coordinator, (1-866-RELMAFYI, info@relmid-atlantic.org). 

Thank you for collaborating with us on this important research project. 



Sincerely, 



Jennifer Bausmith, Ph.D., Study Manager 
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APPENDIX C 

SAMPLE LETTER TO CURRICULUM 
DIRECTORS, WITH ENCLOSURES 

Dear Curriculum Director: 

Approximately one week ago, we sent a letter to all Superintendents to inform them of a new project being under- 
taken by the Regional Educational Laboratory Mid-Atlantic. This pioneering initiative will inventory and docu- 
ment a selection of adopted language arts literacy, math, and science materials in all districts within the Mid- 
Atlantic region. This enterprise will, when complete, prove immediately useful to you and other decision makers in 
your district. 

Data collected will be made available to all educators in the region through two products: 1) a descriptive report 
that provides information about the frequency with which these materials are adopted across the region and 2) an 
interactive, online, and publicly accessible database. District and school personnel will be able to use this informa- 
tion to find out what materials other districts in the region have adopted and which ones are supported by scien- 
tifically-based research. District names and the materials they have adopted will be viewable in the online tool. 
District names will not be used in the written report; only aggregate data will be presented. No individual district 
staff names will be used in either product. 

We request that you provide us with a list of the names of adopted core texts, supplemental materials, and associ- 
ated benchmark assessments in each of the following grades and courses: 

Math: Grade 4, Algebra 1, and Precalculus 

Science: Grade 4, Earth Science, and Physics 
Literacy: Grade 1, Grade 4, and Grade 8 

We have enclosed answers to Frequently Asked Questions and a sample of the data we are collecting to provide you 
with additional information on what data we are seeking. If the lists are part of a larger document, we would be 
happy to accept the whole set and extract the relevant information in our central offices. Lists can be submitted to 
Ryan Casey by fax (732-564-9099), via email (info@relmid-atlantic.org), or by standard mail (call us and we will 
send an envelope with the appropriate postage). Please be sure to include your district name on all materials. 

We will make every effort to keep the burden on district staff as minimal as possible. Districts will be contacted 
in a few weeks to answer any questions you might have. In the meantime, if you have any questions please contact 
Ryan Casey, Program Coordinator, (1-866-RELMAFYI, info@relmid-atlantic.org). 

Thank you for collaborating with us on this important research project. 



Sincerely, 



Jennifer Bausmith, Ph.D., Study Manager 
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District Name 


Name of person completing form 


District County, State 


Title of person completing form 


Date 


Email/contact 



District-level adopted items used by MOST students enrolled in the following: 
SUMMARY TABLE (do not include items adopted at the school or classroom level) 


Language Arts Literacy 


Grade 1 (Reading) 


Core text 


Publisher 


Date of adoption 


Date due for re-adoption 










Supplemental text or 
materials 


Publisher 


Benchmark assessment 


Publisher 










Grade 4 (Language 
Arts) 


Core text 


Publisher 


Date of adoption 


Date due for re-adoption 










Supplemental text or 
materials 


Publisher 


Benchmark assessment 


Publisher 










Grade 8 (Language 
Arts) 


Core text 


Publisher 


Date of adoption 


Date due for re-adoption 










Supplemental text or 
materials 


Publisher 


Benchmark assessment 


Publisher 










Math 


Grade 4 


Core text 


Publisher 


Date of adoption 


Date due for re-adoption 










Supplemental text or 
materials 


Publisher 


Benchmark assessment 


Publisher 










Algebra 1 

(full year course or 
equivalent) 


Core text 


Publisher 


Date of adoption 


Date due for re-adoption 










Supplemental text or 
materials 


Publisher 


Benchmark assessment 


Publisher 










Precalculus 

(full year course or 

equivalent) 


Core text 


Publisher 


Date of adoption 


Date due for re-adoption 










Supplemental text or 
materials 


Publisher 


Benchmark assessment 


Publisher 










Science 




24 



WHAT LANGUAGE ARTS, MATH, AND SCIENCE INSTRUCTIONAL MATERIALS HAVE DISTRICTS ADOPTED? 



District-level adopted items used by MOST students enrolled in the following: 
SUMMARY TABLE (do not include items adopted at the school or classroom level) 



Grade 4 


Core text 


Publisher 


Date of adoption 


Date due for re-adoption 










Supplemental text or 
materials 


Publisher 


Benchmark assessment 


Publisher 










Earth Science 
(full year course or 
equivalent) 


Core text 


Publisher 


Date of adoption 


Date due for re-adoption 










Supplemental text or 
materials 


Publisher 


Benchmark assessment 


Publisher 










Physics 

(full year course or 
equivalent) 


Core text 


Publisher 


Date of adoption 


Date due for re-adoption 










Supplemental text or 
materials 


Publisher 


Benchmark assessment 


Publisher 












The Mid-Atlantic Regional Inventory of Adopted 
Textbooks, Supplemental Materials, and 
Benchmark Assessments in Literacy, Math, 
and Science: frequently asked questions 

Q: How soon do you need this information ? 

A: We ask that you send the information as soon 
as possible. We will begin calling districts to 
follow-up with those who have not responded 
within 2-3 weeks. 

Q: What format do you want this information in? 

A: Whatever format is easiest for you to send, as 
long as you provide complete and accurate informa- 
tion. We have included an example of the kind of 
information we are looking for, but you may send us 
lists that contain additional curricular information 
if this is easier. The following is a possible example: 

Literacy — Grade One (Reading) 

Core Text: Trophies 



Publisher: Harcourt 

Date of last adoption: June 2007 

Date due for re-adoption: June 2012 

Supplemental Materials: Little Books 

Publisher: Harcourt 

Benchmark Assessment: DRA 

Publisher: Pearson 

Science — Earth Science 

Core Text: Earth Science 

Publisher: Glencoe 

Date of last adoption: June 2005 

Date due for re-adoption: June 2010 

Supplemental Materials: Homegrown 

Publisher: n/a 

Benchmark Assessment: n/a 
Publisher: n/a 

Q: Where is my form to fill out? 

A: There are no forms for you to complete. We 
expect that you will send us the requested infor- 
mation in whatever way you gave it to the school 
board for approval. 




APPENDIX C. SAMPLE LETTER TO CURRICULUM DIRECTORS, WITH ENCLOSURES 
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Q; My school district has many schools and we use different 
materials in different schools. How do I know which one(s) 
you want ? 

A: We ask that you send us the information about 
the most commonly used materials across all 
schools in the district. For example, if 8 schools 
use Harcourt and 3 schools use McGraw-Hill, the 
response would be Harcourt. 

Q: Teachers use many different materials in classrooms through- 
out our district, do I need to ask all of them what they use? 

A: No, we ask that you send us lists of materials 
that were officially adopted by the district. 

Q: We have students with varying abilities (e.g., A?, remedial, 
special education, etc) and we use different materials for them. 
Do you want to know the names of all materials for each level ? 

A: No. Please just provide us with the materials 
used in your general education courses. 

Q: We don't use purchased texts or materials in some or all of 
these content areas. How can I convey that information to you? 

A: Just tell us that your texts or materials are 
“homegrown” and do not provide a publisher name. 

Q: We use a published series rather than a single core text for 
language arts literacy so how do I indicate this? 

A: Please identify the name of the series or 
primary text for each content area and grade, 
whichever best applies. 

Q: Our School Board reviews and approves all curricular ma- 
terials on an annual basis and produces a booklet. Can I just 
send you the booklet or do I have to photocopy the pages 
with the grades/courses you ask for? 

A: Yes, you can send us your materials as prepared 
for the School Board review. Please be sure to 



note/highlight the relevant information you send. 
We also ask for the date that the materials were 
adopted and what the curriculum review cycle is 
in your district (e.g., every 3 or 5 years). 

Q: / am very interested in this project. When will the data be 
available and how will we find out about it? 

A: We expect to publish our report in the Fall of 
2009, with the on-line interactive tool becoming 
available soon thereafter. 

Q: Will you be updating the information you receive? 

A: Yes. We will contact districts again, but only 
when the curricula is newly re-adopted as indi- 
cated by your information in this data collection. 

For questions, please contact Ryan Casey, Program Coordi- 
nator, at 1-866-RELMAFYI or info@relmid-atlantic.org. 

REL Mid-Atlantic will protect the confidentiality of all 
respondent information. No information that identifies any 
study participant will be released. No individually identifi- 
able information will be maintained by the study team. 

All individually identifiable information will be kept in 
secured locations and identifiers will be destroyed as soon 
as they are no longer needed. 

Per policies and procedures required by the Education 
Sciences Reform Act of 2002, Title 1, Part E, Section 183, re- 
sponses to this data collection will be used only for statisti- 
cal purposes. The reports prepared for this study will not 
associate responses with a specific individual. We will not 
provide information that identifies you to anyone outside 
the study team, except as required by law. Any willful 
disclosure of such information for nonstatistical purposes, 
without the informed consent of the respondent, is a class E 
felony. 
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APPENDIX D 

NONRESPONDING DISTRICTS 

Note: This list is provided at the request of state 
education agency staff. 



TABLE D1 

List of nonresponding districts 



State 


District 


Grade 

range 


Maryland 


Calvert County Public Schools 


PreK-12 




Garrett County Public Schools 


PreK-12 




Montgomery County Public 
Schools 


PreK-12 


New Jersey 


Berlin Township School District 


PreK-8 




Bloomsbury School District 


PreK-8 




Bound Brook Borough School 
District 


PreK-12 




Byram Township School District 


K-8 




Caldwell-West Caldwell School 
District 


K-12 




Cape May City School District 


PreK-6 




Cape May County Vocational 
School District 


9-12 




Clearview Regional School 
District 


7-12 




Delaware Valley Regional High 
School District 


9-12 




Dover Town School District 


PreK-12 




Downe Township School District 


PreK-8 




East Newark School District 


PreK-8 




East Rutherford School District 


PreK-8 




Eastampton Township School 
District 


K-8 




Evesham Township School 
District 


K-8 




Florence Township School 
District 


K-12 




Franklin Borough School District 


K-8 




Franklin Township School 
District 


K-8 




Gateway Regional School 
District 


7-12 




Greater Egg Harbor Regional 
High School District 


9-12 




Greenwich Township School 
District 


K-8 




Haddon Township School 
District 


PreK-12 







Grade 


State 


District 


range 



New Jersey Haledon School District PreK-8 



Hamburg Borough School 

District K-8 



Kinnelon Borough School 
District 


K-12 


Lebanon Borough School 
District 


K-6 


Mannington Township School 
District 


PreK-8 


Medford Lakes Borough School 
District 


PreK-8 


Merchantville School District 


PreK-8 


Millstone Township School 
District 


K-8 


Moorestown Township School 
District 


K-12 


North Bergen School District 


PreK-12 


North Wildwood City School 
District 


PreK-8 


Oakland School District 


K-8 


Oaklyn Borough School District 


K-9 


Palmyra Borough School District 


PreK-12 


Perth Amboy School District 


PreK-12 


Ridgefield School District 


PreK-12 


Runnemede Borough School 
District 


K-8 


Seaside Park Borough School 
District 


PreK-6 


Secaucus School District 


PreK-12 


Somerville Borough School 
District 


PreK-12 


Upper Deerfield Township 
School District 


PreK-8 


Wallkill Valley Regional School 
District 


9-12 


West Cape May School District 


PreK-6 


West Long Branch School 
District 


PreK-8 



West New York School District PreK-12 



(CONTINUED) 
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TABLE D1 (CONTINUED) 

List of nonresponding districts 



State 


District 


Grade 

range 


New Jersey 


Woodbridge Township School 
District 


K-12 




Woodlynne Borough School 
District 


PreK-8 


Pennsylvania 


Abington Heights School 
District 


K-12 




Ambridge Area School District 


K-12 




Avonworth School District 


K-12 




Baldwin-Whitehall School 
District 


K-12 




Bangor Area School District 


K-12 




Blackhawk School District 


K-12 




Blue Ridge School District 


K-12 




Bristol Borough School District 


PreK-12 




Brookville Area School District 


K-12 




Canton Area School District 


K-12 




Center Area School District 


K-12 




Cheltenham Township School 
District 


K-12 




Chester-Upland School District 


PreK-12 




Commodore Perry School 
District 


K-12 




Coudersport Area School 
District 


K-12 




Crawford Central School District 


K-12 




Fairview School District 


K-12 




Farrell Area School District 


PreK-12 




Forest Area School District 


K-12 




Fort Leboeuf School District 


K-12 




Galeton Area School District 


PreK-12 




General McLane School District 


K-12 




Great Valley School District 


K-12 




Hermitage School District 


K-12 




Jamestown Area School District 


K-12 




Johnsonburg Area School 
District 


K-12 




Lakeview School District 


PreK-12 




Laurel School District 


K-12 




Lower Moreland Township 
School District 


K-12 




Mercer Area School District 


K-12 







Grade 


State 


District 


range 



Pennsylvania Millcreek Township School 

District K-12 



Muncy School District 


K-12 




Neshannock Township School 






District 


K-12 




New Castle Area School District 


K-12 




Northern Bedford County 






School District 


PreK-12 




Northern Potter School District 


K-12 




Northgate School District 


K-12 




Northwestern School District 


K-12 




Octorara Area School District 


K-12 




Otto-Eldred School District 


K-12 




Penn Manor School District 


K-12 




Pennridge School District 


K-12 




Peters Township School District 


K-12 




Plum Borough School District 


K-12 




Port Allegany School District 


K-12 




Punxsutawney Area School 






District 


K-12 




Redbank Valley School District 


K-12 




Reynolds School District 


K-12 




Ridgway Area School District 


K-12 




Riverview School District 


K-12 




Rochester Area School District 


K-12 




Rockwood Area School District 


K-12 




Sayre Area School District 


PreK-12 




Schuylkill Valley School District 


K-12 




Shikellamy School District 


K-12 




Solanco School District 


K-12 




Souderton Area School District 


K-12 




South Allegheny School District 


K-12 




Springfield Township School 






District 


K-12 




Steel Valley School District 


K-12 




Sullivan County School District 


K-12 




Upper Perkiomen School 






District 


K-12 




Warwick School District 


K-12 




Williamsport Area School 






District 


K-12 
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APPENDIX E 

CODING GUIDE USED BY 
PROJECT TEAM IN YEAR 1 

Note: The following is the coding guide used by the 
project team in year 1, with footnotes indicating 
decisions made during the coding process about 
how to resolve inconsistencies. A revised coding 
guide, incorporating those decisions and other 
improvements, is presented in appendix F. 

Submission formats will vary and so it will affect 
the time and decisions involved in coding various 
submissions. 

Submission formats may include: 

• Excel spreadsheets or lists identifying all 
adopted curriculum in district. 

• District-created lists in response to our 
inquiry (i.e., subset of the complete list of 
adopted curriculum). 

• District-completed Summary Tables available 
on website (i.e., Data Recording Form). 

• LES-completed Summary Table or list in a 
Word document. 

• Combination of above strategies. 

Spelling varies across responses — we want to 
ensure “clean” entries (i.e., correct and consistent). 
Drop-down menus that can be updated with new 
items as they are encountered were implemented 
to address this issue in the online data collection 
application. 

There may be multiple submissions of data from 
a single district, or the information may not be 
organized clearly. Look for the most commonly 
used materials (used by the most students) and the 
most recently adopted version of a material. 

There is variation in reported names of core texts 
(for example, one district will report “Houghton 



Mifflin Math (2005)” and another will report 
“Mathematics” as the core text name and “Hough- 
ton Mifflin 2005” as publisher). Do not make infer- 
ences about the titles or publishers; always use the 
names provided by the district. 1 

Extract data only for the academic tracks that 
comprise the most students. These tracks are 
sometimes distinguished as “Academic (A),” or 
“College Prep (CP),” rather than “Honors (H),” 
“Transitional,” or “Advanced Placement (AP) .” 
Choose the Earth Science closest to Grade 8. Data 
coding discrepancies that cannot be resolved 
should be described in the relevant notes section 
in the online application. 

You will see that there are many textbooks with 
similar names published by different companies. 
There are also many textbooks in the same content 
areas all put out by potentially the same publish- 
ers but with slightly different names. Do not make 
inferences about the titles or publishers; always 
use the names provided by the district. 

Publishing companies have changed hands over 
the years. A company may have published an 
Algebra book itself last decade, and then it was 
bought by a large conglomerate and now its name 
is given in the title like “Glencoe Algebra” or “Holt 
Algebra.” However, the real publisher may be 
“Holt, Rinehart & Winston,” which is a company 
under Pearson, or Glencoe/McGraw-Hill, which 
is a division of the McGraw-Hill Companies. (For 
cases like these of “Glencoe Algebra” and “Holt 
Algebra,” published by current conglomerates with 
titles containing names of the former publish- 
ers, the names “Glencoe” and “Holt” are called 
“imprints”). 

The same publisher may have recently published 
many different book series for a particular content 



1. During coding, project leadership determined that titles were to be 
entered exactly as reported by districts, except in cases where the district 
misspells a title or reports the name of the publisher as part of the name of 
the core text (in which case the title was to be entered in the title field and 
the publisher in the publisher field). 



